Recurrence and Polya number of general one-dimensional random walks 
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The recurrence properties of random walks can be characterized by Polya number, i.e., the prob- 
ability that the walker has returned to the origin at least once. In this paper, we consider recurrence 
properties for a general ID random walk on a line, in which at each time step the walker can move 
to the left or right with probabilities I and r, or remain at the same position with probability o 
(I + r + o = 1). We calculate Polya number P of this model and find a simple expression for P 
as, P — 1 — A, where A is the absolute difference of I and r (A = \l — r\). We prove this rigorous 
expression by the method of creative telescoping, and our result suggests that the walk is recurrent 
if and only if the left-moving probability I equals to the right-moving probability r. 

PACS numbers: 05.40.Fb, 05.60.Cd, 05.40.Jc 



Random walk is related to the diffusion models and is 
a fundamental topic in discussions of Markov processes. 
Several properties of (classical) random walks, including 
dispersal distributions, first-passage times and encounter 
rates, have been extensively studied. The theory of ran- 
dom walk has been applied to computer science, physics, 
ecology, economics, and a number of other fields as a 
fundamental model for random processes in time [H-0]- 

An interesting question for random walks is whether 
the walker eventually returns to the starting point, which 
can be characterized by Polya number, i.e., the probabil- 
ity that the walker has returned to the origin at least once 
during the time evolution. The concept of Polya number 
was proposed by George Polya, who is a mathematician 
and first discussed the recurrence property in classical 
random walks on infinite lattices in 1921 0, [fjj]. Polya 
pointed out if the number equals one, then the walk is 
called recurrent, otherwise the walk is transient because 
the walker has a nonzero probability to escape Q- As 
a consequence, Polya showed that for one and two di- 
mensional infinite lattices the walks are recurrent, while 
for three dimension or higher dimensions the walks are 
transient and a unique Polya number is calculated for 
them 0. Recently, M. Stefanak et al. extend the concept 
of Polya number to characterize the recurrence proper- 
ties of quantum walks [9h11|. They point out that the 
recurrence behavior of quantum walks is not solely de- 
termined by the dimensionality of the structure, but also 
depend on the topology of the walk^phoice of coin oper- 
ators, and the initial coin state, etc [9i-tlll]. This suggests 
the Polya number of random walks or quantum walks 
may depends on a variety of ingredients including the 
structural dimensionality and model parameters. 

In this paper, we consider recurrence properties for a 
general one-dimensional random walk. The walk starts 
at x = on a line and at each time step the walker 
moves one unit towards the left or right with probabili- 
ties I and r, or remain at the same position with proba- 



bility o (Z + r + o= 1). This general random walk model 
has some useful application in physical or chemical prob- 
lems, and some of its dynamical properties requires a 
further study. Previous studies of one-dimensional ran- 
dom walk focus on the simple symmetric case where the 
walker moves to left and right with equal probability 
(/ = r = 1/2) [lOj. For instance, Polya showed that 
the symmetric random walk is recurrent and its Polya 
number equals to 1 [l2l. Il3j. However, recurrence prop- 
erties of this general random walk defined here are still 
unknown. As a consequence, we will calculate the Polya 
number for this general random model and discuss its 
recurrence properties. We will try to derive an explicit 
expression for Polya number, and reveal its dependence 
on the model parameters /, r and o. 

Polya number of random walks can be expressed in 
terms of the return probability po(t) [lOl . [Hj], i.e., the 
probability for the walker returns to its original position 
x = at step t, 



P=l- 



1 



E*=oPo(*)' 



(1) 
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Hence, the recurrence behavior of random walk is deter- 
mined solely by the infinite summation of return prob- 
abilities. It is evident that if the summation of return 
probabilities diverges the walk is recurrent {P — 1), and 
if the summation converges the walk is transient {P < 1). 
To calculate the Polya number, it is crucial to obtain 
the return probabilities. In the following, we will calcu- 
late the return probabilities for our general random walk 
model. 

The return probability Po(t) can be obtained using the 
trinomial coefficients of (I + o + r) . Considering an en- 
semble of random walks after t steps, in which the walker 
has L steps moving left, R steps moving right and O 
steps remaining at the same position, then the probabil- 
ity for such random walks is q\jjw\ o°l L r R (l + o + r = 1, 
L + O + R = t). Since the walker's position x is only 
dependant on the difference of right-moving steps R and 
left-moving steps L, x = R— L, returning to the original 
position x = requires R = L. Therefore, the ensem- 
ble of random walks returning to x = involves sum 



2 



over all possible O subject to the constraints R = L and 
R + L + O = t. Because R + L is an even number, t and 
O must have the same parity. Here, we suppose t = 2n, 

= 2i for even t and O, and t = 2n + 1, = 2% + 1 
for odd t and O (i and n are nonnegative integers, and 

1 < n). We calculate the return probability for even t 
and odd t separately. For even i, the return probability 
is given by, 



Po(t)\t=2n = ^2 



(2n) 



i=0 



(2i)!(n-«)!(n-«) 



where t = 2n, O = 2i, R = L = (t - 0)/2 = n-i are 
used in the above equation. Analogously, for odd t, the 
return probability is given by, 



Po(*)|*=a»+i - X) 72iTl3f 



(2n + l)\ 



4=0 



(2i + l)!(n-i)!(n-«)! 



^H+lju—i^n—i 



(3) 

The infinite summation of return probabilities S can 
be determined by the sum of po(2n) and po(2n + 1), 



oo oo 

5 = 5>o(*) = J! (po(*)lt=an + Po(*)l 



t=2n+l 



t=0 



n=0 



(4) 



In order to get a simple expression for S, we define 
A = |r - Z|, thus Ir = ((1 - of - A 2 )/4. Substituting 
this relation into Eq. (j4)), we get 



n=0 
oo n 

E(E 

n=0 i=0 



5* = y^(poft)lt=2n + Po(t)\ t =2n+l 

(2n)! 2l ,(l-o) 2 -A 2 , 



V 

^f2z+ 1 



(2i)!(n - i)!(n - i)\ y 4 7 
(2n + l)! o 2» + i( ( 1 -°) 2 - A2 y 



i=0 



(2i + l)!(n-«)!(n-i)! 



(n!) 2 1 



(2n)! / (1 - o) 2 - A 2 



•)' 



x ^ 2 F x (-n, -n, 1/2, (1 _ o ° a _ A2 ) + 

(2n + l)o aJi (-n, -n, 3/2, (1 _ o ^_ A ) , 

(5) 

where 2-^1(01,6,0,2;) is the Gauss Hypergeometric func- 
tion, can be further simplified, for the sake of clarity, 
we first consider the case o = 0. When o — the Hy- 
pergeometric function equals to 1, S can be simplified 

as, 



^ o (n!) 2 V 4 J A' 



(6) 



The last equality follows from the Taylor series expansion 
at z — for the function 1 / yl — 4z. 

For o > 0, we find that 5 1 also equals to I /A. This 
result is surprising because S does not depend on the 



remaining unmoving probability o. This suggests that, 
for all o and A, Eq. §5§ can be simplified as, 



S 



V < o,A < l,o + A < 1. 



(7) 



It is difficult to simplify Eq. (|5|) or prove Eq. ([7]) using 
the usual mathematical methods. Here, in the appendix, 
we prove this rigorous expression (JT]) by the method of 
creative telescoping. The method of creative telescop- 
ing is an algorithm to compute hypergeometric 
summation, definite integration, and prove combinato- 
rial identity. Using this method, we transfer S to the 
solution of a partial differential equation (See the proof 
in the appendix). 

The Polya number in Eq. ([TJ can be written as, 



1 



(8) 



Consequently, we find a simple explicit expression for 
Polya number, which is solely determined by the absolute 
difference of I and r, A = \l — r\. 

According to Eq. ©, Polya number P equals to 1 for 
A = 0. This suggests that the walk is recurrent if and 
only if the left-moving probability I equals to the right- 
moving probability r. Our result is consistent with previ- 
ous conclusion that one-dimensional symmetric random 
walk (/ = r = 1/2) is recurrent. Our result also indicates 
that the infinite summation of return probabilities S di- 
verges for A = and converges for A ^ 0. To verify this 
point, we plot the return probability po(t) as a function 
of step t in Fig. Q] We find that po(t) is a power-law 
decay as p {t) - t-°- 5 for A = (See Fig. Q] (a) in the 
log-log plot) and exponential decay for A 7^ (See Fig.Q] 
(b), (c) in the log- linear plot). Since Po{t) for A = 
decays slower than t~ x and decays faster than t~ x for 
A^fl, the infinite summation S diverges for A = and 
converges otherwise. Particularly, by means of Stirling's 
approximation n\ « \Z2nn(n/ 1 e) n for o = 0, we find an 
asymptotic form for the return probability in Eq. 

Po(t) « v/^(l - A 2 )'/ 2 for even t and p (t) = for odd 
t. For a certain value of A > 0, the decay behavior of 
Po{t) seems different for different values of o (See Fig. Q] 
(b), (c)). However, the summations of Po(t) for different 
o are identical and equal to 1/A. This result is some 
what unexpected and we provide a strict proof in the 
appendix. 

In summary, we have studied recurrence properties for 
a general ID random walk on a line, in which at each 
time step the walker can move to the left or right with 
probabilities / and r, or remain at the same position with 
probability o (l+r+o = 1). We calculate Polya number P 
of this model for the first time, and find a simple explicit 
expression for P as, P = 1 — A, where A is the absolute 
difference of / and r (A = |Z — r|). We prove this rigorous 
relation by the method of creative telescoping, and our 
result suggests that the walk is recurrent if and only if 
the left-moving probability I equals to the right-moving 
probability r. 
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The basic idea of creative telescoping algorithm is to find 
a linear recurrence equation for the summands F(z,n). 
This could be done by constructing a differential operator 
L with coefficients being polynomials in z, and a new 
function G(z,n) satisfying, 



L(z)F(z, n) = G(z, n + 1) - G(z, n). 



(A2) 



t 60 



100 



Thus L(z) operating on the summation ^2 n F{z,n) is 
determined by the difference of upper bound and lower 
bound G (z) = G(z,n max ) - G(z,n mm ). Then we just 
need to check both sides of Eq. (jAll) satisfy recurrence 
equations: L(z)Y /n F(z,n) = G Q (z), L(z)f(z) = G {z), 
and check Eq. (IA1[) holds for some initial conditions. 

Several algorithms for computing creative telescoping 
relations have been developed in the past [l7| . The main 
programs are Zeilberger's Maple program and Math- 
cmatica progr am written by Peter Paule and Markus 
Schorn jl7H13 |. Here, we use the mathematical program 
to compute the creative telescoping relation for our prob- 
lem. 



Appendix B: Proof of 5" = ^ using MCT 



FIG. 1: (Color online) Return probability po(t) as a function 
of step t for A = (a), A = 0.2 (b) and A = 0.4 (c). For 
each value of A, we plot po(t) vs t for o — (black squares), 
o = 0.2 (red dots) and o = 0.4 (blue triangles). The critical 



decay for convergence po(t) 



t~ 



are also plotted in the 



figure. po(t) shows a power-law decay t~ 5 for A = (See 
(a)), and po(t) exhibits exponential decay for A > (See (b) 
and (c)). It should be pointed out that for the case o > 0, 
Po(t) is nonzero at all values of t, while po(t) is zero at odd t 
for o = 0. 
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Appendix A: The method of creative telescoping 
(MCT) 

The method of creative telescoping, also known as Zeil- 
berger's algorithm is a powerful tool for solv- 
ing problem involving definite integration and summa- 
tion of hypergeometric function. Suppose we are given 
a certain holonomic function of two variables F{z, n) 
(n 6 Integers, z <E Reals), and it is required to prove 
that the summation of F(z,n) over n equals to f(z), 



F(z,n) = f(z). 



(Al) 



In this section, we prove S — 4- using the method 
of creative telescoping (MCT). We use the Mathemat- 
ica package Holonomic Functions [lj], US H3 to create a 
recurrence relation for the summands s„ (o, A) in Eq. (0 , 



2oD a + AD A + 1 + (S n 



l)^D A )s n (o,A)=0, (Bl) 



where D Q , £>a are the partial differential operator {D D = 
d/do, Da = d/dA), S n is the shift operator satisfying 
5»/(n) = /(n + l). 

Summing over n leads to, 



[2oD + ADa + 1 )S 



^(5 n -l)- J D A s„(o,A) = 0. 

(B2) 

The second term in the above equation is a telescoping 
series, the central terms are cancelled and only leave the 
last term and first term. Noting that ^Das„.(o, A) are 
zero for n = and n — > oo, the second term in Eq. (|B2[) 
equals to 0. Hence the infinite summation of return prob- 
abilities S satisfies, 



2oD a + AD a + 1)5 = 



(B3) 



It is easy to check ^ also satisfies the above partial dif- 
ferential equation. Combining with the initial condition 
S = 3 for o = (See Eq. ©), S = £ holds for all o and 
A. 
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